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THE SHAPE OF INCOMPLETE PREFERENCES^ 

By Robert Nau 

Duke University 

Incomplete preferences provide the epistemic foundation for mod- 
els of imprecise subjective probabilities and utilities that are used in 
robust Bayesian analysis and in theories of bounded rationality. This 
paper presents a simple axiomatization of incomplete preferences and 
characterizes the shape of their representing sets of probabilities and 
utilities. Deletion of the completeness assumption from the axiom 
system of Anscombe and Aumann yields preferences represented by 
a convex set of state-dependent expected utilities, of which at least 
one must be a probability /utility pair. A strengthening of the state- 
independence axiom is needed to obtain a representation purely in 
terms of a set of probability /utility pairs. 

1. Introduction. In the Bayesian theory of choice under uncertainty, a 
decision maker holds rational preferences among acts that are mappings 
from states of nature {s} to consequences {c}. It is typically assumed that 
rational preferences are complete, meaning that, for any two acts X and Y, 
either X ^ Y (X is weakly preferred to Y) or else Y ^ X, or both. This 
assumption, together with other rationality axioms such as transitivity and 
independence, leads to a representation of preferences by a unique subjective 
probability distribution on states p{s) and a unique utility function n(c) 
on consequences, such that X ^ Y if and only if the subjective expected 
utility of X is greater than or equal to that of Y [1, 5, 24]. However, the 
completeness assumption may be inappropriate if only partial information 
about the decision maker's preferences is available, or if realistic limits on her 
powers of discrimination are assumed, or if there are many decision makers 
whose preferences may disagree. 
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Incomplete preferences are generally represented by imprecise (set-valued) 
probabilities and/or utilities. Varying degrees and types of imprecision have 
been modeled previously in the literature of statistical decision theory and 
rational choice: 

1. If probabilities alone are considered to be imprecise, then preferences 
can be represented by a set of probability distributions {p{s)} and to- 
gether with a unique, exogenously-specified utility function u{c). The set 
of probability distributions is typically convex, so the representation can 
be derived by separating hyperplane arguments (e.g., [7, 15, 29, 31, 33]). 
Representations of this kind are widely used in robust Bayesian statistics 
[22, 32] and they are also attracting interest in economics [19]. 

2. If utilities alone are considered to be imprecise, preferences can be rep- 
resented by a set of utility functions {u{c)} and a unique, exogenously- 
specified probability distribution p{s), a representation that has been 
axiomatized and applied to economic models by Aumann [2] and Dubra, 
Maccheroni and Ok [4]. The set of utility functions in this case is also 
typically convex, so that separating hyperplane arguments are again ap- 
plicable: the roles of probabilities and utilities are merely reversed. 

3. If both probabilities and utilities are allowed to be imprecise, they can be 
represented by separate sets of probability distributions {p{s)} and utility 
functions {u{c)} whose elements are paired up arbitrarily. This represen- 
tation of preferences preserves the traditional separation of information 
about beliefs from information about values when both are imprecise 
[20, 21]. It lacks a compelling axiomatic basis, but it arises naturally 
when imprecise probabilities and utilities are assessed independently, as 
they often are in practice. 

4. More generally, incomplete preferences can be represented by sets of 
probability distributions paired with state-independent utility functions 
{(p(s), ii(c))}, a.k.a. "probability/utility pairs." This representation has 
an appealing multi-Bayesian interpretation and provides a normative ba- 
sis for techniques of robust decision analysis [14] and asset pricing in 
incomplete financial markets [30]. It has been axiomatized by Seidenfeld, 
Schervish and Kadane [28] (henceforth SSK), starting from the "horse lot- 
tery" formalization of decision theory introduced by Anscombe and Au- 
mann [1]. However, as pointed out by SSK, the set of probability/utility 
pairs is typically nonconvex and may even be unconnected, so that sep- 
arating hyperplane arguments are hard to apply. Instead, SSK introduce 
methods of transfinite induction and indirect reasoning. 

The objective of this paper is to derive a simple representation of in- 
complete preferences for the elementary case of finite state and reward 
spaces, and to characterize the shape of the resulting sets of probabilities 
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and utilities. First, it is shown that deleting both completeness and state- 
independence from the horse-lottery axiom system of Anscombe and Au- 
mann leads to a representation of preferences by a set of probabilities paired 
with state- dependent utility functions {{p{s) , u{s , c))} . Such pairs will be 
called state- dependent expected utility (s.d.e.u.) functions. State-dependent 
utilities have been used in economic models by Karni [9] and Dreze [3] and 
are also discussed by Schervish, Seidenfeld and Kadane [25]. A set of s.d.e.u. 
functions is typically convex — unlike a set of probability/utility pairs — so 
that separating-hyperplane methods are still applicable at this stage. Next, 
the usual state-independence axiom is reintroduced and shown to impose 
(only) the further requirement that the representing set should contain at 
least one probability/utility pair, analogous to SSK's result establishing 
one-way agreement between a partially ordered preference relation and a 
nonempty set of probability/utility pairs. However, those assumptions are 
too weak to yield two-way agreement in which every extremal preference has 
an agreeing state-independent utility, because the state-independence axiom 
may have limited applicability when preferences are incomplete. The main 
result of this paper is to show that two-way agreement between incomplete 
preferences and state-independent utilities can be achieved by strengthen- 
ing the state-independence axiom. Although the representing set of probabil- 
ity/utility pairs is nonconvex, it is characterized simply as the intersection of 
a convex set of s.d.e.u. functions and the nonconvex set of state-independent 
utilities. 

The organization of the paper is as follows. Section 2 introduces ba- 
sic notation and derives a representation of preferences by convex sets of 
s.d.e.u. functions when neither completeness nor state-independence is as- 
sumed. Section 3 incorporates Anscombe and Aumann's state-independence 
assumption and shows that it requires (only) the existence of at least one 
agreeing state-independent utility. Section 4 discusses an example of SSK to 
highlight the implications of different continuity and strictness conditions. 
Section 5 presents the stronger constructive axiom that is needed to obtain 
a representation purely in terms of probability /utility pairs, illustrated by 
another example. Section 6 briefly discusses the results. Proofs are given in 
the Appendix. 

2. Representation of incomplete preferences. Let S denote a finite set of 
states and let C denote a finite set of consequences. Let B = {B : 5 x C i— > K}. 
An element X € S is a (horse) lottery if X > and \/ s,J2c-^i^''^) — 
with the interpretation that X{s,c) is the objective probability of receiving 
consequence c when state s occurs. Henceforth, the symbols X, Y, Z and H 
will be used to denote lotteries; the symbol B will denote an element of B 
that is not necessarily a lottery (e.g., B will typically represent the difference 
between two lotteries). A lottery X is constant if the probabilities it assigns 
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to consequences are constant across states — that is, if X{s,c) =X{s',c) for 
all s, s', c. The symbol ^ will denote weak preference between lotteries: X ^ 
Y means that X is preferred or indifferent to Y, which is the behavioral 
primitive. The domain of ^ is the set of all lotteries. The asymmetric part 
of ^ is denoted by y, but it will not be used except in stating axiom A5. 
An extension of ^ is any preference relation that is stronger in the sense 
that X ^ Y implies X Y but not necessarily vice versa. 

An event is a subset of S. The symbols E and F will be used interchange- 
ably as names for events and for their indicator functions on S x C, so that 
for all c, E{s,c) = 1[0] if the event E includes [does not include] state s. E^ 
will denote the indicator vector for state s, so that for all c, Es(s',c) = 1[0] 
if s = s'[s ^ s']. If a is a scalar between and 1, then aX + (1 — a)Y is 
an objective mixture of X and Y: it yields consequence c in state s with 
probability aX{s, c) + (1 — a)Y{s, c). If E is an event, then EX + (1 — E)Y 
is a subjective mixture of X and Y: it yields consequence c in state s with 
probability X{s,c) if E{s,c) = 1, and with probability Y{s,c) otherwise. 

Assume that C contains a "worst" and a "best" consequence, labeled 
and 1, respectively. This assumption follows Luce and Raiffa [13] and 
Anscombe and Aumann [1], and it is technically without loss of generality 
in the sense that the preference order can always be extended to a larger 
domain that includes two additional consequences which, by construction, 
are better and worse, respectively, than all the original consequences. (Such 
an extension is demonstrated by SSK, Theorem 2.) The best and worst con- 
sequences ultimately serve to calibrate the definition and measurement of 
subjective probabilities, but even so the probabilities remain somewhat ar- 
bitrary, as will be shown. Intermediate consequences are labeled 2,3, ... ,K, 
and for all c € {0, 1,2, ... , K}, He denotes the special lottery that yields con- 
sequence c with probability 1 in every state. That is, for all s, Hc(s, c') = 1[0] 
if c' = c[c 7^ c]. 

The first group of axioms that are assumed to govern rational preference 
is as follows: 

Al {Quasi order) ^ is transitive and reflexive. 

A2 (Mixture-independence) X ^ Y <^ aX+ (1 - Q!)Z ^ q;Y + (1 - a)Z Va G 
(0,1). 

A3 ( Continuity in probability) If {X„} and {Y.„} are convergent sequences 
such that X„ ^ Y„, then limX„ ^ lim Y„. 

A4 (Existence of best and worst) For all c > 1, Hi ^ He ^ Hq. 
A5 (Coherence or nontriviality) Hi ^ Hq (i.e., not Hq^Hi). 

Al and A2 are von Neumann and Morgenstern's first two axioms of expected 
utility, minus completeness, as applied to horse lotteries by Anscombe and 
Aumann [1]; see also [5]. A3 is a strong continuity condition used by Garcia 
del Amo and Ri'os Insua [6] that also works in infinite-dimensional spaces. 
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A4 and A5 ensure nontriviality and provide reference points for probability 
measurement, as noted earlier. 

The following definition (following SSK) will prove useful for distinguish- 
ing a subset of preferences that implicitly determines the entire preference 
order: 

Definition. A collection of preferences {X,„ ^ Yn} is a basis for ^ 
under an axiom system if every preference X ^ Y can be deduced from 
{X„ ^ Y.„} by direct application of those axioms. 

The primal geometric representation of ^ is now given by the following: 

Theorem 1. ^ satisfies A1-A5 if and only if there exists a closed con- 
vex cone B* C B, receding from the origin, such that X^Y<^4>X — YGi3*. 
In particular, if {X„ ^ Y„} is a basis for ^ under A1-A5, then B* is the 
closed convex hull of the rays whose directions are {X„ — Y„} for all n, 
together with {Hi — He} and {He — Hq} for all c. 

Thus, the direction of preference between two lotteries X and Y depends 
only on their difference X — Y, with X ^ Y if and only if X — Y is in a 
convex cone B* of preferred directions. It follows that if EX + (1 — E)Z ^ 
EY + (1 - E)Z, where E is an event, then EX + (1 - E)Z' ^ EY + (1 - 
E)Z' for any Z', which is the so-called "sure-thing principle": where two 
lotteries agree, it does not matter how they agree there. Henceforth, be- 
cause agreeing conditional components of lotteries do not affect preferences, 
the expression EX ^ EY will be used as shorthand for EX -|- (1 — E)Z ^ 
EY + (1 — E)Z for all Z, which means that X is preferred to Y condi- 
tional on the event E, or, equivalently, that E(X — Y) is a preferred di- 
rection. Similarly, for conditional lotteries embedded in objective mixtures, 
aEX-|- (1 — a)X' ^ aEY + (1 — a)Y' will be used (in Section 5) as shorthand 
for a(EX + (1 - E)Z) + {1 - a)X' >z a(EY + (1 - E)Z) + {1 - a)Y' for all 
Z, meaning that aE(X — Y) + (1 — a)(X' — Y') is a preferred direction. 

To set the stage for the representation of incomplete preferences by sets 
of state-dependent utilities, let a state- dependent expected utility (s.d.e.u.) 
function be defined as a function v: S x C ?R., with the interpretation that 
v{s,c) is an expected utility associated with consequence c when it is to be 
received in state s, and let '■ B ?R. denote the utility function on lotteries 
that is induced by v according to the linear formula 

C/,(X)= ^ X{s,c)v{s,c). 
seS,ceC 

In particular, C4(EsHc + (1 — E^jHo) =v{s,c). 
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Definitions, (i) An s.d.e.u. function -y is a probability/utility pair if it 
can be expressed as the product of a probability distribution p: 5 i— > [0, 1] 
and a state-independent utility function u: C i— so that v{s,c) =p{s)u{c) 
for all s and c. (ii) An s.d.e.u. function v agrees (one way) with ^ if X ^ 
Y =^ ?7t,(X) > C/„(Y). (iii) A set V of s.d.e.u. functions represents ^ if X ^ 



A V that agrees with ^ is unique only up to positive linear scaling and the 
addition of state-dependent constants and, by A4, it must satisfy [/^(Hq) < 
C/„(Hc) < C/t,(Hi); hence, there is no loss of generality in assuming that it 
belongs to the normalized set 



In these terms, the dual to Theorem 1 can now be given as follows: 

Theorem 2. ^ satisfies A1-A5 if and only if it is represented by a 
nonempty closed convex set of s.d.e.u. functions V* G V"*". In particular, 
if {X„ ^ Y„} is a basis for ^, then V* is the set of v ^ satisfying 



The proof relies on a separating hyperplane argument. (For a similar 
result on a more general space, see [21].) If the basis is finite, then V* is 
a convex polytope whose elements need not be probability /utility pairs. 
Subsequent sections of the paper will discuss the additional assumptions 
needed to ensure that some points of V* — especially its extreme points — are 
probability /utility pairs. 

3. The state-independence axiom. An additional axiom of Anscombe 
and Aumann, which they call "monotonicity in the prizes" or "substitutabil- 
ity," provides the usual separation of subjective probability from utility, and 
its implications in the context of incompleteness will now be explored. (Es- 
sentially the same axiom appears as P3 in Savage's system [24].) Some ad- 
ditional notation will be helpful. First, for all (0,1), let Hp denote the 
lottery that yields the best and worst consequences with probabilities p and 
1 — p in every state, which is the objective mixture 



Next define He as the lottery that yields the best consequence if event E 
occurs and the worst consequence otherwise, that is, the subjective mixture 



Y ^ U^{X) - U^{Y) > G V. 




{C/,(X„)>f/,(Y„)}. 



HpEEpHi + (l-p)Ho. 



He = EHi + (1-E)Ho. 



A not-potentially-null event can then be defined by a comparison of subjec- 
tive and objective mixtures: 
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Definition. An event E is not potentially null if He ^ Hp for some 
p>0. 

The additional axiom asserts that conditional preferences among constant 
lotteries may be propagated from not-potentially-null events to all other 
conditioning events: 

A6 (State-independence) If X and Y are constant and E is not poten- 
tially null, then EX ^ EY =^ FX ^ FY for every other event F. 

This assumption of state-independent preferences among constant lot- 
teries makes possible the assignment of state-independent utilities to the 
underlying consequences, which is central to the program of defining subjec- 
tive probabilities in terms of preferences. A6 together with A4 ensures that 
consequences and 1 are worst and best in every state, that is, E^jHo ;^ 
E^Hc :< E^Hi for all s and c, which implies U^,{Esllo) < C/„(EsHc) < f/^(E^Hi) 
for every agreeing v, which is equivalent to v{s,0) < v{s,c) < v{s,l). The 
s.d.e.u. functions representing a relation that satisfies A6 can therefore be 
normalized to lie within the set 



Under this normalization, it is "as if" consequences and 1 have state- 
independent utilities of and 1, respectively, and the probability assigned to 
state s by f can be interpreted as 



because this is the expected utility of a lottery that yields a utility of 1 if 
state s obtains and a utility of otherwise. Correspondingly, the probability 
assigned to any event E by is defined by the summation 



(The same approach is used by Karni [10].) Under this interpretation, bounds 
on subjective probabilities can be expressed by the decision maker in either 
primal or dual terms in light of Theorems 1-2. The assertion that "the 
probability of E is at least p" that is, that p is a lower probability for E, 
is defined primally by the preference He ^ Hp and dually by the constraint 
that Pv(Ei) >P for any v agreeing with ^. Upper probabilities are defined 





Pv{s) =p„(Es) =v{s,l) 



p,{E) = U,{UE) = J2py{s). 
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analogously. An event is not potentially null if it has a strictly positive lower 
probability. 

Unfortunately, the attribution of state-independent utilities to consequences 
is ultimately arbitrary and untestable: the decision maker's true utilities 
could have state-dependent origin and scale factors, even if the state-inde- 
pendence axiom is satisfied, in which case the conventionally-defined subjec- 
tive probabilities would not represent true degrees of belief. (State-dependent 
utility scale factors would have exactly the same effects as beliefs.) The clas- 
sic behavioral definitions of subjective probability given by Savage, Anscombe- 
Aumann and others all suffer from the same arbitrariness. The intrinsic im- 
possibility of inferring true probabilities from material preferences is dis- 
cussed in more depth by Karni, Schmeidler and Vind [12], Rubin [23], 
Kadane and Winkler [8], Schervish, Seidenfeld and Kadane [25], Karni and 
Mongin [11] and Nau [16, 17]. 

Notwithstanding those caveats, the s.d.e.u. function can be further de- 
composed by dividing the expected utility of consequence c in state s by the 
probability of the state to obtain 

Uvis,c)=v{s,c)/p^{s) ifpt,(s)>0 

as the utility assigned to consequence c in state s. This utility is state- 
independent if u is a probability/utility pair, and otherwise it is state- 
dependent. In these terms, the expected utility assigned to any lottery X 
by V can be rewritten as the expected value of a possibly-state-dependent 
utility: 

C/„(X) = ^Pvis) ^ Uy{s, c)X{s, c). 

s c 

If is a probability /utility pair, then v{s,c) = py(Eis)Uy(H.c) for all s and c. 
Bounds on expected utilities can also be expressed in both primal and dual 
terms. The assertion that "the expected utility of X is at least u" is de- 
fined primally by the preference X ^ H„ and dually by the constraint that 
Uv{^) > u for any v agreeing with ^ . Similarly, for conditional expected 
utility, define 

C/,(X|E) = C/,(XE)/p,(E), 

provided Pv{^) > 0. Then the assertion "the conditional expected utility 
of X given E is at least it" has the primal definition EX ^ EH^ and the 
dual definition that CZy(X|E) > u for any v agreeing with ^ and satisfying 
Pt,(E) > 0, because, for any agreeing v 

EX t EH„ =^ Uy (EX) > Uy (EH„) = upy (E) 
<^ f/^(X|E) > u or else p„(E) = 0. 
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If preferences are complete, in addition to A1-A5, then the primal repre- 
sentation B* expands to an entire half-space of preferred directions and the 
dual representation V* shrinks to a unique s.d.e.u. function v*. When A6 is 
also assumed, the unique v* must be a probability/utility pair, which is the 
result obtained by Anscombe and Aumann [1] . In the absence of complete- 
ness, the contribution of A6 to the separation of probability and utility is 
weaker, as summarized by the main theorem of this section: 



Theorem 3. ^ satisfies A1-A6 only if it is represented by a nonempty 
closed convex set of s.d.e.u. functions V** € V'^"'' on which the maximum 
and minimum expected utilities of every constant lottery are achieved at 
probability /utility pairs. In particular, if {X„ ^ Y„} is a basis for ^ under 
axioms A1-A6, then V** contains every probability /utility pair v G V'*"'' that 
satisfies {Uy(X.n) ^ Uy(Yn)}, of which there must be at least one. 



Apart from the fact that V** contains all the probability /utility pairs 
in that agree with the basis preferences, its "shape" is not easy to 

describe, as will be illustrated in Section 5. 

An immediate implication of Theorem 3 is the property of stochastic dom- 
inance, namely, that if X is obtained from Y by shifting probability mass 
to consequence 1 from any other consequence, and/or from consequence 
to any other consequence, in any state, then X ^ Y because in this case 
Uv(X.) > Uv(Y) for all v E V^"^. To make this result more precise, let the 
[•]min (minimum s.d.e.u.) operation be defined on B as 



[Blmin = niin C/t,(B)=min 

1.GV++ SG5 



+ ^min{0,5(s,c)} 

c>2 



This quantity is the minimum possible state-dependent expected utility that 
could be assigned to B: it is achieved by assigning, within each state, a utility 
of to those consequences c > 2 for which B is positive and a utility of 1 to 
those consequences c > 2 for which B is negative, then assigning a subjective 
probability of 1 to the state in which the conditional expected utility of B 
is minimized. Stochastic dominance and the negative orthant in B can now 
be defined in a natural way: 



Definitions, (i) X >* [>*]Y ("X [strictly] dominates Y") if [X - 
Y]min ^ [>]0- (ii) The open negative orthant B~ consists of those B that 
are strictly dominated by the zero vector, that is, B' = {B € 6:0 >* B} = 
{BeB: B{s, 1) + Ec>2 max{0, B{s, c)} < Vs}. 

Theorem 3 then implies that X >* [>*] Y ^ X ^ [^] Y. 
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4. Strict vs. weak preference: an example. The closedness of the repre- 
sentative sets of s.d.e.u. functions in Theorems 2 and 3 is attributable to the 
use of weak preference as the behavioral primitive, together with a strong 
continuity assumption. In contrast, SSK use strict preference as the behav- 
ioral primitive, together with a weaker continuity assumption, to explicitly 
allow for the representation of incomplete preferences by open sets that may 
fail to contain probability /utility pairs. 

The differences in these approaches are illustrated by an example of 
SSK (Example 4.1) involving two states and three consequences, that is, 
S = {1,2} and C = {0,1,2}. Consequences and 1 have state-independent 
utilities of and 1 by assumption, so that a probability /utility pair can 
be parameterized by the probability assigned to state 1 and the utility as- 
signed to consequence 2. Consider two probability /utility pairs {pi,Ui) in 
which po{l) = 0.1, pi{l) = 0.3, uo(2) = 0.1 and ui{2) = 0.4. Let vq and vi 
denote the corresponding s.d.e.u. functions — that is, Vi{s,c) =pi{s)ui{c) for 
i = 0, 1. Then J/^,. (X) denotes the expected utility assigned to lottery X 
by {pi,Ui), with Uyg{'H.2) = 0.1 and [7^,1 (H2) = 0.4. Now let >- be defined 
as the preference relation that satisfies a weak Pareto condition with re- 
spect to these two probability /utility pairs — that is, X Y 44> {C/t,g(X) > 
C/t,(j(Y) and [/^.^(X) > ?7t,j(Y)}. Any s.d.e.u. function that is a convex com- 
bination of vq and vi also agrees with y, so the representing set V** is the 
closed line segment whose endpoints are vq and vi, but none of its interior 
points are probability/utility pairs. 

Next SSK extend >- to obtain a new preference relation y" by impos- 
ing the additional strict preferences H0.4 H2 Hq.i- The effect of this 
extension is to remove the two endpoints of the representing set of s.d.e.u. 
functions, so that y" is represented by the open line segment connecting vq 
with vi. SSK point out that, although y" satisfies all their axioms, there 
is no agreeing probability /utility pair for it, since the only two candidates 
have been deliberately excluded. They proceed to axiomatize the concept 
of "almost state-independent" utilities, which agree with a strict preference 
relation and are "within e" of being state- independent. Clearly, y" has an 
almost-state-independent representation, containing points arbitrarily close 
to Vq and vi. 

In the present framework, where weak preference is primitive, there is no 
way to implement a constraint such as H2 >- Hq.i except by asserting that 
H2 ^ Ho.i+e for some e > 0. If this assertion is made, axiom A6 begins to 
nibble on the vq end of the line segment and continues nibbling until the 
representation collapses to the vi end. (See [18] for details.) If instead the 
other endpoint is removed, by adding the constraint Ho.4-e ^ H2 for e > 0, 
collapse occurs to vq. If both constraints are added, the entire interval is 
annihilated, yielding incoherence (a violation of A5). Hence, this example is 
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unstable in the sense that any finite extension of the original preference rela- 
tion leads to a collapse to one or the other of the original probability/utility 
pairs, or else to incoherence. 

5. The need for stronger state-independence. In the preceding example 
a strict preference relation was represented by an open set of s.d.e.u. func- 
tions whose extreme points were state- independent, and in extending that 
relation by imposing e-tighter weak preferences, it was impossible to retain 
any agreeing state-dependent utilities that were not convex combinations 
of agreeing state-independent utilities. A second example shows that this 
is not always the case under axioms A1-A6: the representing set of state- 
dependent utilities is not always a convex hull of state-independent utilities, 
so that nonconstant lotteries may have lower or upper expected utilities 
that are not supported by any probability /utility pairs. This is not due to 
the choice of weak vs. strict preference as a primitive, but rather due to an 
inherent weakness of the usual state-independence axiom in the absence of 
completeness. A6 serves (only) to extend conditional preferences between 
constant lotteries to other conditioning events, but, without completeness, 
there may be few pairs of constant lotteries whose conditional preferences 
are known, and hence, there may be limited opportunity to apply this axiom. 

To illustrate this problem, let there be three states and three conse- 
quences, and let X be the lottery defined by 0) = X{2, 2) = X{3, 1) = 1. 
That is, X yields consequences 0, 2 and 1 with certainty in states 1, 2 and 3 
respectively. Suppose that all states are judged to have probability at least 
0.1, and X is judged to have an unconditional expected utility of at least 0.5. 
Furthermore, a coin flip between X and {consequence 2 if state 1, otherwise 
Z} is preferred to a coin flip between utility 0.5 and {utility 0.9 if state 1, 
otherwise Z}, but also a coin flip between X and {utility 0.1 if state 2, oth- 
erwise Z} is preferred to a coin flip between utility 0.5 and {consequence 2 
given state 2, otherwise Z}. The common alternative Z in each comparison 
is arbitrary by Theorem 1. The basis for ^ can then be expressed as 

(5.1) He^Ho.! for E = Ei,E2,E3, 

(5.2) XfeHo.5, 

(5.3) ^EiH2 + ^X ^ iEiHo.9 + ^Ho.5, 

(5.4) iE2Ho.i + ^XfeiE2H2 + iHo.5, 

where the arbitrary common term ^(1 — Ei)Z has been suppressed on both 
sides of (5.3), and likewise ^(1 — E2)Z has been suppressed in (5.4). Notice 
that, by Theorem 1, (5.2) implies ^EiY + ^X >: ^EiY + ^Hcs for any Y, 
from which (5.3) has been constructed by replacing Y with H2 on the LHS 
and replacing it with Hq.q on the RHS. Similarly, (5.2) implies ^E2Y + 
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^ iE2Y + ^Ho.5, from which (5.4) has been constructed by replacing 
Y with Hq.i on the LHS and with H2 on the RHS. These two new preferences 
imply that the lower bound on the expected utility of X among all probabil- 
ity/utility pairs agreeing with ^ must be strictly greater than 0.5, which can 
be seen as follows. First, an s.d.e.u. function v agrees with (5.3) if and only 
if C/„(X) - ;7^,(Ho.5) > [/^(EiHo.g) - ^7^,(ElH2), and it agrees with (5.4) if 
and only if C4,(X) — UyCHo,^) > J7t,(E2H2) — C4,(E2Ho.i). Second, because 
Uy{ilo,i) < C/t,(Ho.9), any v must satisfy either C/t,(Ho.9) — C/t,(H2) > or 
Uy{H2) — t4'(Ho.i) > or both, and if w is a probability /utility pair that 
agrees with (5.1), it must also satisfy the corresponding conditional inequali- 
ties C/„(EiHo.9) - ;7^,(EiH2) > or C/„(E2H2) - C/„(E2Ho.i) > or both, be- 
cause El and E2 have positive lower probability. Hence, a probability/utility 
pair V can agree with (5.1), (5.3) and (5.4) only if Uv(X.) — ?7i,(Ho.5) > 0, 
that is, ^7i,(X) > 0.5. In fact, by nonlinear programming, the minimum ex- 
pected utility of X among all agreeing probability/utility pairs is achieved 
at p(l) = 0.41, p(2) =0.1, p(3) = 0.49,n(2) = 0.379/0.51 = 0.74314, and its 
value is p{2)u{2) +p{3) = 0.564314. 

However, by direct application of axiom A6 together with A1-A5, the 
expected utility of X cannot be determined to be strictly greater than 0.5. 
To apply A6, it is first necessary to find nonnegative linear combinations of 
the differences between the LHS's and RHS's of (5.1)-(5.4) that are condi- 
tionally constant — that is, of the form EB, where E is a not-potentially-null 
event and B is constant across states. But the search for such conditionally 
constant terms is constrained here by the presence of a nonconstant term 
proportional to X — H0.5 in the differences between LHS's and RHS's of 
(5.2)-(5.4), as well as by the use of two different conditioning events in (5.3) 
and (5.4). Furthermore, in order for A6 to "bite," B needs to have a negative 
lower expected utility when conditioned on some other event F. The effect 
of applying A6 will then be to raise this lower expected utility to zero, which 
shrinks the set of s.d.e.u. functions representing ^. In the example the few 
conditionally-constant lottery differences EB that can be constructed from 
(5.1)-(5.4) all turn out to satisfy B >* 0, which is uninformative. (This can 
be determined by solving a sequence of 14 linear programs.) The lower ex- 
pected utility of X therefore remains at 0.5 despite the fact that this value 
is not realized, or even closely approached, by any probability/utility pair 
agreeing with ^. 

This example shows that when preferences are incomplete, axiom A6 is 
insufficient to guarantee that they are represented by (the convex hull of ) 
a set of probability/utility pairs. Evidently, a stronger condition is needed, 
such as follows: 

A6* {Strong state-independence) If X and Y are constant, X' ^ Y', and 
He ^ Hp and Hp ^ Hq with p> 0, then 

oEX + {1- a)X' ^ aEY + {1 - a)Y' 
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=^ /?FX + (l-/3)X'fc;3FY + (l-/3)Y' 
for /3 = 1 if a = 1 and otherwise for all (3 such that < | . 

In words, A6* requires that whenever a weak preference between two arbi- 
trary lotteries X' and Y' is preserved under an objective mixture with two 
conditional constant lotteries EX and EY, respectively, and the common 
conditioning event E is not potentially null, then the same preference is pre- 
served under a mixture with the same constant lotteries conditioned on any 
other common event F, where the odds-ratio of the new mixture can be at 
least as large as the original odds-ratio multiplied by the ratio of the lower 
probability of E to the upper probability of F. In terms of a primal set B*** 
of preferred directions, A6* requires that if B' G B*** and B' + EB G g***^ 
where B is constant and E is not potentially null, then B'+ {p/q)F'B € B*** . 
If ^ satisfies A1-A6, then it must have an extension that also satisfies 
A6*, because A1-A6 require the existence of at least one agreeing prob- 
ability/utility pair, and the additional preferences implied by A6* do not 
eliminate any agreeing probability /utility pairs. The scale factor p/q ensures 
precisely that, even in the worst case where U^CB') > 0, [^(B) < 0, Pv(Ei) = P 
andp,(F)=(7, U,{B') + p„{E)U,(B) >0 ^ U,{B') + ip/q)p„{F)U,{B) >0 
for any v that is a probability/utility pair. 

The stronger axiom does affect the counterexample discussed above. Let 
B' = X — Ho.5, in terms of which (5.2), (5.3) and (5.4) are equivalent to 
B' eB***, B' + Ei(H2-Ho.9) gS*** and B' + E2(Ho^-H2) € respec- 
tively. By linear programming, Ei, E2 and E3 are found to have identical 
lower probabilities of 0.1 and upper probabilities of 0.41, 0.4444. . . and 0.8, 
respectively. A6* can then be applied to add the following preferred di- 
rections to B***: B' + (0.1/0.4444. . .)E2(H2 - H0.9), B' + (0.1/0.8)E3(H2 - 
H0.9) , B' + (0.1/0.41)Ei (Hq^ - H2) and B' + (0.1/0.8)E3 (Hg^ - H2) . These 
vectors must have nonnegative expected utility under any agreeing s.d.e.u. 
function, which immediately raises the lower expected utility of X from 0.5 
to 0.54, and further iterations of A6* approach the lower limit of 0.564314 
among agreeing probability/utility pairs. However, iteration of A6* via lin- 
ear programming and vertex enumeration is a cumbersome way to compute 
probability and utility bounds. The main theorem of this section shows that 
there is a simpler way: 

Theorem 4. ^ satisfies A1-A5 and A6* if and only if it is represented 
by a nonempty set V*** G V"*"^ of s.d.e.u. functions that is the convex hull of 
a set of probability /utility pairs. In particular, if {X„ ^ Y„} is a basis for 
^, then V*** is the convex hull of the set of probability /utility pairs in V"*"^ 
that satisfy {C/„(X„) > Uy{Yn)}. 
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If the basis is finite, the construction of V*** can be carried out as fol- 
lows. First, form the convex polytope defined by the constraints {C/„(X„) > 
Uy{Yn)}, V € V"*"^. Next, take the intersection of this polytope with the 
nonconvex set of all probability/utility pairs. (If the latter intersection is 
empty, the preferences do not satisfy A5 given A1-A4 and A6*: they are 
incoherent.) Finally, take the convex hull of what remains: this is the set 



6. Discussion. It has been shown that, in order to obtain a convenient 
representation of incomplete preferences by sets of probability /utility pairs, 
it does not suffice merely to delete the completeness axiom from the stan- 
dard axiomatic framework of Anscombe and Aumann, due to a fundamen- 
tal weakness of the traditional state-independence axiom in the absence of 
completeness. The approach here has been to substitute a stronger state- 
independence postulate (A6*), which still has "bite" in the absence of com- 
pleteness. This approach follows a common theme in axiomatic rational 
choice theory, namely, the search for a small number of independent, con- 
structive norms of behavior which collectively turn out to imply the existence 
of measurable beliefs and values. 

Seidenfeld [26] has suggested a modified approach: instead of directly 
strengthening the state-independence property, simply "compel the miss- 
ing preferences" by the principle of indirect reasoning, namely, compel the 
preference Y ;^ X [Y ^ X] whenever the contrary assertion X ^ Y [X ;^ Y] 
would lead to a violation of the prevailing axioms in light of preferences 
already known. According to this principle, wherever a weak [strict] prefer- 
ence is "precluded," the opposite strict [weak] preference must be affirmed. 
In the example of the previous section, it is not directly implied by A1-A6 
that X ^ for any u > 0.5, yet the same axioms preclude that H,j ^ X 
for any u < 0.564314. If indirect reasoning were invoked, the preferences 
X y Hu would immediately be compelled for all u < 0.564314. By the same 
token. Theorem 3 would suffice to fix the lower [upper] expected utility of 
any lottery at the minimum [maximum] achieved among all agreeing prob- 
ability/utility pairs, and the stronger state-independence axiom A6* would 
not be needed for the tighter representation of Theorem 4. (SSK use indirect 
reasoning in a more limited role to deal with closure of the sets of target 
utilities in their model, a step which is avoided here through the use of weak 
rather than strict preference as a primitive.) 

Indirect reasoning, otherwise known as modus tollens {{p ^ q) A ^q) 
-ip), is a tautological implication of two- valued propositional logic; hence, 
it applies to preferences that are complete: if either X ^ Y or else Y ;^ X 
must be true, then if one is precluded, the other naturally must be affirmed. 
Indirect reasoning also applies tautologically to incomplete preferences un- 
der axioms A1-A5 (only), because according to Theorem 1, the preference 
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X ^ Y merely adds the new direction X — Y to the convex cone B* of 
preferred directions, which is to say, it interacts linearly with preferences 
aheady known. Thus, X ^ Y is precluded precisely when X — Y combines 
linearly with an existing element of B* to produce a vector in the open neg- 
ative orthant, implying that Y — X + Z € -B* for some Z G B~ , which does 
entail Y ;^ X. However, the tautology breaks down when the conventional 
state-independence axiom A6 is added to the mix, because the new direc- 
tion X — Y then interacts nonlinearly with an already-known direction of 
preference if they can be linearly combined to yield a conditionally constant 
direction that can be propagated to other conditioning events. When the 
new conditional directions are also added to the cone, a vector in the open 
negative orthant may result, thus precluding X ^ Y even if it is not already 
implied that Y ;^ X. Under these conditions, indirect reasoning becomes a 
logically separate "axiom" of rational choice to which we may or may not 
wish to subscribe. 

The argument in favor of indirect reasoning is that, at the end of the day, 
the decision maker in the example of Section 5 might face a choice between, 
say, X and H0.54. If the preference H0.54 ^ X is precluded, it would appear 
as though the choice of H0.54 over X should also be precluded, in which 
case the implication X >~ H0.54 would appear to be inescapable as a require- 
ment of rational choice. However, the counterargument is that the point of 
dropping the completeness assumption is precisely to permit the decision 
maker to judge some alternatives to be noncomparable, which weakens the 
link between preference and choice to a one-way implication: a preferred al- 
ternative should be chosen where it exists, but a chosen alternative need not 
be preferred if the alternatives are regarded as noncomparable. In the exam- 
ple, X and H0.54 are noncomparable under axioms A1-A6 given (only) the 
preferences (5.1)-(5.4), hence, either may be chosen on that basis, and the 
choice of H0.54 over X is in fact supported by some agreeing state- dependent 
utilities that are not ruled out by A6 because of the relatively weak con- 
straints it imposes on the shape of the agreeing set V**. (What is actually 
precluded is not the preference of H0.54 over X per se, but rather the addi- 
tional conditional preferences that would be implied by declaring Ho.54^ X 
in the presence of A6.) Still, even if indirect reasoning is not an inescapable 
requirement of rational choice, it can be defended as an axiom that might be 
useful to enforce when preferences are incomplete, as it is used elsewhere in 
the foundations of mathematics (e.g., in geometry). However, in this regard, 
it does not have the elementary character of the other axioms and cannot be 
tested independently of them, so it is still of interest to ask whether there is 
some other "direct" postulate that will reduce indirect reasoning once again 
to a tautology, and that is precisely what A6* accomplishes here. 

This paper has considered the case of finite sets of states and conse- 
quences. SSK consider the somewhat more general case of a countable set 
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of consequences and a finite partition of a possibly-infinite underlying state 
space. However, it is often desirable to consider even more abstract settings 
involving uncountable sets. The case in which the state space is a compact 
subset of 3?" and the consequence space is a compact subset of 9? or is of 
particular importance (e.g., in financial economics), where a lottery would 
naturally be defined by a probability density or cumulative mass at a given 
consequence in a given state. The axioms of this paper are applicable to such 
objects, and Theorems 1 and 2 can still be obtained by appropriately gen- 
eralized separating hyperplane theorems: the primal representation of ^ is 
again a convex cone whose directions are differences between more-preferred 
and less-preferred lotteries, and the dual representation is a convex set of 
agreeing s.d.e.u. functions; indeed, just such a representation is given by Gar- 
cia Del Amo and Rfos Insua [6] . The further restriction to state- independent 
representations consisting of sets of probability/utility pairs is more prob- 
lematic but very much of interest in order to reduce the dimensionality of 
the parameter space in Bayesian robustness applications. Under suitable 
regularity (e.g., smoothness) conditions, it might be conjectured that a rep- 
resentation of incomplete preferences by sets of state-independent or almost 
state-independent utilities could still be obtained, since any discretization 
of the state space and consequence space would have to satisfy Theorems 3 
and 4 of this paper. The issue of "missing preferences" would presumably 
still arise, requiring either an axiom such as A6* of this paper or else the 
indirect reasoning principle. An analogous set of results in Savage's frame- 
work (which requires an infinite state space but does not involve objective 
probabilities) would appear to be more difficult to obtain, since it does not 
lend itself to the same techniques of convex analysis that are made possible 
by objective mixtures, although his state-independence axiom is essentially 
the same as that of Anscombe-Aumann and might be expected to suffer a 
similar loss of traction in the absence of completeness. 

APPENDIX 

Proof of Theorem 1. Suppose that X - Y cx X' - Y', that is, a(X - 
Y) = (1 — a)(X' — Y') for some a G (0, 1), where X, Y,X', Y' are lotteries. 
Then, by the mixture-independence axiom, X ^ Y 44> aX + (1 — a)X' ^ 
aY + (1 - a)X' = aX + (1 - a)Y' <^4> X' ^ Y', establishing that there is a 
cohection of vectors B* such that B e B* ^ aB e B* y a > and X ^ Y <^ 
X — Y € . Mixture- independence and transitivity together imply that if 
X Y and X' ^ Y', then aX + (1 - a)X' ^ aY + (1 - a)Y' , establishing 
that B* is convex. The best /worst axiom establishes that B* is nonempty 
(in particular, it includes He — Hq and Hi — He for c > 1), but coherence 
requires that it not be the whole space (in particular, it excludes Hq — Hi), 
and the continuity axiom implies that it is closed. □ 
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Proof of Theorem 2. Every convex cone B* C B is associated with 
a dual cone V* CB such that B e B* if and only if Uy{B) = v^B > for 
all V gV*, and coherence requires that UyCRi — Hq) > for all v £ V* . 
Since the elements of B* are differences between pairs of lotteries, their 
components sum to zero within states. Hence, Uy{B) > <J4> Uy'{B) > 0, 
where v'{s,c) = av{s,c) + (3{s) for a > and arbitrary {(3{s)}, so w.l.o.g. it 
can be assumed that v € V"*". □ 



Proof of Theorem 3. It suffices to show that a preference relation 
satisfying A1-A6 can be extended to assign a unique state-independent util- 
ity to any consequence c > 1. This extension can then be performed for 
c = 2,3, . . . , K , in turn, to obtain a unique state-independent utility func- 
tion, for which every agreeing s.d.e.u. function is a probability/utility pair. 
Therefore, consider some consequence c > 1, and let u{c) denote the max- 
imum value of u such that He ^ H„ — that is, the greatest lower utility for 
consequence c. (The maximum exists by virtue of continuity.) Since A1-A5 
apply, there exists a cone of preferred directions representing ^. When A6 
also applies, let this cone be denoted by B**: in this case it contains all vec- 
tors of the form Es(Hc — H^^^))- Then ^ can be coherently extended so as 
to assign c an upper utility also equal to u{c). To show this, let B** denote 
the convex hull of B** and the rays whose directions are 'Es(H.u{c) ~ He) for 
all states s, noting that these vectors are opposite in sign to those already 
known (by A6) to belong to B** . Since B** is also a convex cone, it repre- 
sents a relation satisfying A1-A4; and since it is formed by adding to B** 
a difference between two constant lotteries and all the conditionalizations 
thereof, the relation it represents also satisfies A6. If B** is also disjoint from 
the negative orthant B~ , then the relation it represents is coherent and is 
the desired extension ^e- It remains to be shown, then, that B** is disjoint 
from B~ . Suppose that this is not true. Then there must exist B G B** and 
{P{s)} e [0,1] such that 



-B- ^/3(s)E,(H„(e)-He) 



>0 



-B - ( ^(1 - /?(s))E,(He - H,(e)) ) - (H,(, 

\se5 / 

-B' - (H„(e) - He)]jnin > 0, 



>0 

J min 



where 



B' ^ B + ^(1 - /3(s))E,(He - H„(e)). 

ses 

Note that B' € B** , because B** includes all vectors of the form E(He — 
H„(e)) and their nonnegative linear combinations. Rearrangement of the last 
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inequality yields (He — 'H.u{c)) > B', which is equivalent to (He — H„(e)+£) ^ 
B' for some e > 0. Because He — H„(e)+e stochastically dominates B' E B** , 
it follows that He — H„(e)+£ € B**, whence also He ^ H„(e)+£- Thus, u{c) + 
e is a lower utility for c, contradicting the assumption that n(c) was the 
greatest lower utility for c under the relation ^, therefore B** must be 
disjoint from B~ . Finally, the same method of extension, namely, adding 
a preference which asserts that the greatest lower utility is also an upper 
utility, can be applied to an arbitrary constant lottery X prior to {He} to 
show that the maximum or minimum expected utility of a constant lottery 
must be achieved by an agreeing probability/utility pair. □ 

Proof of Theorem 4. The earlier results (based on A1-A6 only) es- 
tablish that ^ is represented by a convex cone of preferred directions and 
dually by a convex set of s.d.e.u. functions containing at least one probabil- 
ity/utility pair. When the stronger A6* holds, let these sets be denoted by 
B*** and V***, respectively. It must be shown that V*** is the convex hull of 
a set of probability/utility pairs, which means that, for any lotteries X, Y, 
the minimum of C/t,(X) — Uy(Y) over all v G V*** is achieved at some v which 
is a probability/utility pair. Suppose that d = min^gv***(fA;(X) — Uv{Y)). 
Since Uy(H.o) = and f/^(Hu) = u, it follows that d is the maximum value 
of u for which 

(7.1) C/„(iX+iHo)>t/.(iY + iH„) 

for all V G y***^ or, equivalently, the maximum value of u for which ^X + 
^Hq ^ + ^H„, or, equivalently, the maximum value of u for which 
X + Hq — Y — H„ € B***. To prove that there is a probability/utility pair 
for which (7.1) holds with equality, it will suffice to show that ^ has an ex- 
tension satisfying A1-A6, denoted ^rf, in which the reverse preference also 
holds, namely, ^Y -I- ^H^ ^X + ^Hq. [It is not necessary to enforce the 
stronger axiom A6* on because if (7.1) holds with equality for all v 
agreeing with A6 guarantees via Theorem 3 that at least one must be a 
probability /utility pair.] The primal representation of is constructed as 
follows. First, define B^ = X + Hq — Y — H^, noting that it is an extreme 
direction of B***. Then include the reverse preference by adding to the con- 
vex cone B*** the ray whose direction is —^d- Then apply A1-A3, which 
convexifies the set, yielding an expanded cone. (A4 and A5 are automatically 
satisfied thus far.) Finally, apply A6 (the special case of A6* with a = 1), 
which means to (i) determine which new conditional directions of the form 
FjBj, where Fj is a not-potentially-null event and B^ is constant, are in the 
expanded cone; (ii) then propagate the same conditional preferences to all 
possible conditioning events by adding the directions {EcjBj} for all s and 
i; and (iii) take the convex hull again. Thus, the primal cone consists of all 
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vectors of the form Bq - 7^6^ + J2s,ilsi^s^i, where Bq € B*** , 7^ > and 
7sj > 0. Suppose that one such vector is in the open negative orthant B~ , 
in violation of A5, that is, suppose that Bq — ^d^d + J2s ilsi^s^i = Z, or, 
equivalently, 

(7.2) Bo + ^7s»E,Bi = 7rfBrf + Z, 

s,i 

where Bq € B*** and Z S B^ . It will be shown that this leads to a contra- 
diction. 

Because the conditional direction FjBj is in the convex hull of B*** plus 
the additional direction — B^, but not in B*** alone, it satisfies B^ + FjBj G 
B*** . Because B^ € B*** and each Fj is not-potentially-null and the origi- 
nal relation ^ satisfies A6*, there exist positive constants {5si} such that 
Brf -t- 5siEsBj G B*** for all i and s. Multiplying through by 'jsi/Ssi, 
summing and invoking the convexity of B*** yields {J2s i^si/Ssi)'^d 
+ Es,i7siE,Bi G B***, whence also Bq + iEs,i7si/Ssi)'Bd + Y.lilsi'EsBi G 
B*** . Adding {J2s ilsi/ 5si)Bd to both sides of (7.2) and comparing, it follows 
that (7d + Es,i7si/<5.i)Bd + Z G B**\ Multiplication hy k = {ld + T.s,ilsi/ SsiT^ 
yields B^ -|- /cZ G B*** , where /cZ G B~ , contradicting the assumption that 
Brf was an extreme direction of B*** and constructively proving the existence 
oiu>d for which iX + iRo + iH„. □ 
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